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Abstract 

We demonstrate that the Dirac representation theory can be effectively adjusted and applied 
to signal theory. The main emphasis is on orthogonality as the principal physical 
requirement. The particular role of the identity and projection operators is stressed. A Dirac 
space is defined, which is spanned by an orthonormal basis labeled with the time points. An 
infinite number of orthonormal bases is found which are labeled with frequencies, they are 
distinguished by the continuous parameter a. In a way, similar to one used in quantum 
mechanics, self-adjoint operators (observables) and averages (expectation values) are 
defined. Non orthonormal bases are discussed and it is shown, in an example, that they are 
less stable compared to the orthonormal ones. A variant of the sampling theorem for finite 
signals is derived. The aliasing phenomenon is described in the paper in terms of aliasing 
symmetry. Relations between different bases are derived. The uncertainty principle for finite 
signals is discussed. 
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1. Introduction 

Signal theory is based largely on functional analysis and theory of distributions, 
on continuous and discrete systems. Quantum mechanics have similar mathematical 
problems [1], [2]. Moreover the distributions were employed by Dirac [1] in his 
representation theory before they gained a solid mathematical basis [3-5]. Dirac's 
representation theory is not just a different way of presenting known theories, it has 
its own special features which allow it to be extended to new theoretical problems 
[6] . Today it is almost impossible to think about new developments of quantum 
theory without the use of the transparent and deep formulations based on Dirac's 
representation theory. Such was, for example, Feynman's path integral formulation 
of quantum theories [7] . For a recent application see ref [8]. The analogies of 
quantum theories and signal theory were pointed before [9], [10]. Here we 
concentrate mainly on the formulation of the basics of signal theory by using Dirac's 
representation theory. Elsewhere we discuss the feedback that signal theory may 
have on quantum theory. As the basics of signal theory require quite a large 
presentation, we were compelled to describe them in two papers, this paper, paper I, 
dealing with discrete finite signals, and paper II, dealing with infinite duration 
(continuous and discrete) signals [11]. 

In quantum mechanics, in one-dimension, the physical states corresponding to 
different eigenvalues are orthogonal. Therefore orthogonality is much more than a 
convenient tool for expansion of functions in terms of a convenient orthogonal basis. 
On the other hand the space of quantum states is a normed space and normalization 
of states is required. Usually, when the coordinates are extending to infinity, in order 
to secure normalizability, boundary conditions has to be imposed. 
For scattering states, which are unbound, the situation is different, and one has to 
use generalized eigenfunctions, defined on rigged Hilbert spaces, which were 
initially developed by Gel'fand [12], [13], [14] , more elaborated by Maurin [15], 
and adapted to quantum mechanics by Roberts [16], Bohm [17], Antoine [18] and 
others [19]. 
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The plan of our presentation is described below. We start in section 2 with the 
basics of Dirac's representation theory, trying to show its essentials by representing 
the bras and kets with rows and columns respectively. We introduce there the notion 
of coherent states and discuss the consequences of restricting the vector space to a 
subspace. In sec. 3 we introduce the "Dirac space" of dimension equal to the number 
of signal data. We discuss the orthogonal bases labeled with time and angular 
frequencies respectively. The analogy to the quantum wave functions is fully 
employed and averaged quantities are proposed. In sec. 4 we discuss nonorthogonal 
bases. In paper II we prove the well known sampling theorem using the methods of 
Dirac's representation theory by depicting it as a relation between the complete 
discrete time basis in the subspace, generated by restricting the frequencies, and the 
overcomplete continuous time basis. Here, in sec. 5, we give a different variant of 
the sampling theorem. We decompose the Dirac space into two subspaces of equal 
dimensions. The sampling theorem here is the relation between the complete basis in 
a subspace and the overcomplete basis obtained by projecting the basis of the Dirac 
space into the subspace. In sec. 6 we derive and discuss the symmetries which are 
leading to the aliasing phenomenon. In sec. 7 we introduce the signal and spectral 
operators respectively, and discuss their relation to the spectral amplitude and to 
double distributions. In sec. 8 some identities are derived. The uncertainty principle 
is the subject of sec. 9. In sec. 10 we summarize and discuss our findings. 



2. A representation for the bra-kets 



In Dirac's representation theory [1] the state (the system, the function or the 

object) are described by an abstract vector denoted as a ket vector Pi,P2,---) , where 

inside are the parameters which specify the state. Usually one can get results only 
after specifying the components of the ket vector. One can get them by projecting 
the vector into a set of unit vectors which form a basis for a linear complex space . 
In order to perform the projection we need to define a scalar product of two vectors. 
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This can be achieved by defining the dual space of bra vectors. Dual to the ket 



vector Pi,P2,---/ is the bra vector (pi,p2 ,...| , which properties we describe below. 

In finite dimensions, the space of kets or bras is an abstract (separable) Hilbert 
space. In infinite dimensions one has to deal, for bound states, with the Hilbert space 
[2], and for unbound states, with rigged Hilbert spaces [12-19]. 

One can gain a better insight by considering finite dimensional vectors. For 
example 



a) = 



, (a| = (ai* 



(2.1) 



where | a)^is the hermitian conjugate (or the complex conjugate of the transpose) 
of I a) . The scalar product can be defined in the usual way: 



(a|a) = (ai* a^ 



- aj aj + ajH — i-a„ a„ 



(2.2) 



An equivalent definition, in the spirit of Dirac's representation theory will be: 

/ I \ [0 for i # j 

<i|a) = ai, i = l,2,---n; (a|i> = ai*; (i|j) = 5ij=j^ for i = j 

(a|a) = ^ (a|i)(i|a) = a^*a^ + a2*a2+-"+ajj*ajj 



(2.3) 



Here the vectors | i) can be considered as a set of orthonormal vectors spanning an n 

dimensional basis for the vectors | a) : 

|a) = ajl) + a2|2)+---+ajn). (2.4) 

The scalar product (i|a) is the projection of |a) in the direction |i) . 

The Dirac formalism allows, beside the scalar product, to consider the "dyadic" 
product of two vectors: 
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|a)(b| = 




(b; b/ • 




f 1 * 

a^bi 
a2bi* 


aib2* • 
a2b2* • 


•• aib„* 
•• a2b„* 










.anbi* 


a„b2* • 


•• a„b„* 



From eqs. (2.5) and (2.3), for an orthonormal basis, one can get 

1 



(2.5) 



I-I |k)(k| = 



k=l 



1 



, (nxn 



unit matrix 



(2.6) 



One can consider the expression in eq. (2.6) as the definition of the identity 
operator I, and rewrite eqs. (2. 1) and (2.2) in the form: 

(a|a) = (a||l|a) = (a|( 21|k)(k| )|a) = a/a^ + a2*a2+---+a„*a„. (2.7) 

k 

Equation (2.6) represents the completeness relation, in the sense, that any vector in 
the n dimensional ket space can be expanded uniquely with the basis I k) : 



( n 



a) = l|a)= |k)(k| |a) = i:(k|a)|k) = J^a,|k 



(2.8) 



Vk=l J k=l i=l 

It may be advantageous to introduce the operator (a matrix): 



F = I |k>fk(k|, 



(2.9) 



k=l 



which we will call the "filter operator". It can reduce the dimensions of the 
considered space if some of the fi are equal to zero. We shall apply such operators in 
signal analysis when constraints will be put on the frequency space basis. A 
particular case of a filter operator is the projection operator P which satisfies the 
condition: 

P = P^=P^ (2.10) 
In a way similar to the definition of the bra as the hermitian conjugate of the ket in 
eq. (2.1), one can define the adjoint of an operator (matrix). If A is an operator 
whose action is given by 

A|a) = |b), (2.11) 
then the adjoint operator is defined by: 
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(b| = (a|A^ 

Other definition of the adjoint operator follows the relation: 

(b|A|a) = (a|A^|b). 



(2.12) 



(2.13) 



Further simplifications are possible if we note that for a projection operator 

P = pI (2.14) 
Eq. (2. 14) can be proved easily if we note that from eq. (2. 10) by conjugation we 
obtain: 



(2.15) 



Combining eqs. (2.10) and (2.15) we obtain: 

which reduces to eq. (2. 14). An important example of a projection operator for the 
orthonormal basis (2.6) is 



P = I |k)Pk(k|, 



(2.16) 



k=l 



where the coefficients pk are either equal to 1 or to 0. Let us consider two examples. 
Example 1. Consider two orthonormal bases in a three dimensional space C (of 
complex numbers): 















ll>= 







1 


^ |3) = 







.0. 




.0. 







and: 














1 









with the identity operator (unit matrix): 



|3> 



( 1 A 







(2.17) 



3 









0^ 


1 = 1 


; ik>(ki=i ik')(ki= 





1 







1 k=l 


.0 





1> 



(2.18) 



Let us impose now a constraint that all vectors of the system are confined to a 
subspace Cp^ spanned by the basis vectors | T) and |2') . This constraint will be 
realized with the help of the filter operator (now also a projection operator): 
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F = |l')(l'| + |2')(2'| = F^, (2.19) 
where is the adjoint operator (or hermitian conjugate operator). 
Any three dimensional vector | a) 

|a)= ai|l)+a2|2) + a3|3) = ai,|l') + a2^|2') + a3.|3'), (2.20) 
will be projected into the required subspace Cp by the operation (eq. 2. 19): 
F| a)= ai,|l') + a2.|2') = aiF| l) + a2F|2) + ajFj 3 



, , ^ , ^ ■ , ^ (2-21) 

= a,(^|l'» + a2(|2')) + a3(-:^|l'>). 



One can use eq. (2. 18) and note here an interesting result for the identity operator Ip 
in the constrained subspace Cp : 

Ip =|1')(1'| + |2')(2'| = FI F^=F|lXl| F"'" +F|2X2|Fi" +F|3X3|F\ (2.22) 

I \ 2 

i.e. the states F| k), (k=l,2,3), form an overcomplete nonorthogonal basis for Cp . 
Any vector m Cp ^ can be expanded in a unique way in this basis: 

I b) = bi, I F) + b2. 1 2') = biF| l) + b2F| 2) + h,F\ 3), (2.23) 
and from eq. (2.22) we obtain: 

I b) = Ip I b) = (1 |F"'' I b)F| 1) + (2 |F"'' I b)F| 2) + (3|F"'' | b)F| 3) , (2.24) 
with the expansion coefficients 

b,=(k|F^|b). (2.25) 
Comparing eqs. (2.23) with eq. (2.21) we can see that a vector in C will have the 
same expansion coefficients in Cp if the (overcomplete nonorthogonal) basis given 
by eq. (2.24) will be used. States which form an overcomplete nonorthogonal basis 
with a continuous basis index, are being referred in ref [20] as "coherent states". 
Here we shall use this term also for a discrete basis. 

Now we are able to generalize the previous example and formulate the following 
theorem: 

Example 2. The Projection Theorem. 

Let I k) be an orthonormal n dimensional basis in C", satisfying the completeness 

n 

relation I„ = ^ I k){k | , where In is the identity operator in C". Let C™ be an m 
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dimensional subspace of C" (m<n) spanned by the orthonormal basis |k') and the 
corresponding identity operator 



(2.26) 



k'=l 



Let P be a projection operator projecting vector states from C" into vector states of 
C™. Then any vector state | b)^ of C™ can be expanded in C" according to 



Ib)„=£ bjk), 



(2.27) 



where 



b,=(k|P^|b)^ = £ (k|P^|k')(k'|b)^, k=l,2,...n, 



(2.28) 



k'=l 



and 



I.=I P|k)(k|p-'-, 



(2.29) 



k=l 



i.e. the expansion coefficients bk are calculated in C™ using the coherent basis P| k) . 
The second part of eq. (2.28) was obtained by using eq. (2.26). 

3. Orthonormal bases in the Dirac space 



In practice, the analog signal u(t) is being usually sampled, every time interval At, 
with a sampling rate: 

fs-l/At. (3.1) 
Let us assume that the sampling contains K data points at times: 

tk=kAt, k=l,2,...,K . (3.2) 
Following the ideas of Dirac we can represent the sampled signal u(tk) 
(k=l,2,...K) by the ket-vector in the K dimensional vector space: 

^u(ti)^ 



|u) = V 



vu(tK)y 



(3.3) 
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which we will call the Dirac space. Above v is a normalization constant to be 
discussed later on. The Dirac space is spanned by the canonical basis: 
















1 




' 1^2) = 




.0, 




.0, 



tK) = 



(3.4) 



so that 

(tk|u) = vu(tj. 
If we normalize the ket (3.3) to unity, then 



(3.5) 



v = l/j£u*(t,)u(t,), 



(3.5a) 



' k=l 



and the ket (3.3) will have a similar significance as wavefunction in quantum 
mechanics and we will be able to speak about probability amplitudes. The scalar 
product: 



u|u) = 2^ [vV(t,)][vu(t,)] = l, 



(3.5b) 



has the meaning that the sum of all probabilities must equal one. The identity 
operator (the unit matrix) can be written as: 

K 



1 = 1 |tO(tl 



(3.6) 



k=l 



In order to perform spectral analysis we introduce a new basis for the Dirac space 

|co,), k=l,2,...,K, (3.7) 

linked with the angular frequency projections. The basis (3.7) is connected with the 
basis (3.4) via the matrix: 

(t„|cOk) = Tiexp(icOktJ, (3.8) 

where the angular frequencies cOk will be determined later in accord with the 
discrete Fourier transform (DFT). Thus in the Dirac space this new basis will have 
the following components: 
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|«k) = l|«k) = L(t„|«k)|t„) = Tl 



n=l 



^exp(icOkti)^ 
exp(ic0kt2) 



(3.9) 



We will require orthonormality of this basis: 
From eqs. (3.2), (3.6) and (3.9) we get: 



(3.10) 



(«n |co J = i:(co„ |t,)(t, |co J = H^J^e'^"^^* . (3.11) 

k=l k=l 

The sum can be evaluated using the summation formulae of the geometric series: 

(3.12.a) 



1 2 K-1 ^ 1 
1 + X + X +...+X = 

x-1 



x'^-l 
x-1 



(3.12b) 



where eq. (3. 12.b) was obtained by multiplying eq. (3. 12b) by x" . We obtain: 



^ai(tOm-tOn)At 



and the orthonormality conditions will be: 



,i(COm-CO„)KAt _ J 



,i(COni-CO„)At 



1 



(3.13) 



27r(n - m) 
co„ - (0„ = = (n - m)Aco, 



n m 



KAt 

Aco = 24KAt)"' =27ifs /K, 
1 



(3.14) 



In eq. (3. 14) the difference n-m is an integer, but n and m separately do not have 
to be integers, one can add to them an overall real constant, denoted below as a, 
which will be canceled when differences will be taken. Therefore we may 
choose: 

co„„ = (a + n- l)Aco, n = l,2,...,K, (3.15a) 

where a is the overall constant. The identity operator (the unit matrix) will take the 
form: 
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(3.15b) 



k=l 



i.e. there are infinite number of orthonormal bases, characterized by the real 
constant a, with which one can cover any angular frequency. The choice a =0 is 
consistent with the standard DFT (except for normalization, r|=l/K for DFT) for 
which we have an orthonormal basis for the angular frequencies: 
^exp(icOkti)' 

co^ =(k-l)Aco, k = 0,1,2,. ..K-1. 



1 



exp(i(0kt2) 



(3.16) 



.exp(icOktK). 

and the identity operator (the unit matrix) will take the form: 

K 
k=l 

The spectral amplitude, for this case, will be: 

K 1 

U(coJ^(cOi,|u) = (c0k|t„)(tju) = ^2^ vu(tjexp(-ic0i,tj. 

n=l V K n=l 

For a different from zero instead of eq. (3.16) we have: 

exp(i(cO], +ocAa))ti) 
exp(i(a)]^ +ocAa))t2) 

exp(i(a)], +aAco)tK) 



(3.17) 



(3.18) 



CO 



k,a 



(3.16a) 



and more generally: 



CO, 



n=l 



tn)(t„|u)-^f; u(tJexp(-ico,,„tJ, (3.18a) 

n=l 



and its inverse, the signal, with its spectral decomposition 



u(tk)^ 



u) = ^f U(co„,Jexp(ico„t,), (3.19) 

VV K n=l 



where, for the derivation of eqs. (3.18-9), eqs. (3.6), (3.15b) and (3.17) were used. 
It is interesting to note that by choosing different values of a one can reach all 
values of the angular frequency -oo<a)<oo, therefore eq. (3.18) can be used as both 



12 



an interpolating and an extrapolating formula for the principal frequencies chosen 
with a specific value of a (like eq. (3.16)). In this case we can rewrite eq. (3. 18a) in 
the following way: 



V 



U(co)s(co|u) = 2^ (co|t„)(t„|u) = ^£ u(tJexp(-icotJ, (3.20) 

n=l VK n=l 

which, for real signals, has the following symmetry: 

U*(co) = U(-co). (3.21) 

The spectral power is defined as: 

P(co) = |U(co)|' . (3.22) 
The spectral power, for real signals, can also be evaluated as follows: 

K K 

P(co) = (u|co)((o|u) = £ (u|t„)(t„|(o)j; (co|tk)(tk|u) 



n=l k=l 
2 K K , , ,,2 K K 



(3.23) 



= ^11 -(tnMt,)e-('"-'^)=^i:i: u(t„)u(t,)cos(t„-t,). 

n=lk=l n=lk=l 



An example for the power dependence on frequency, using eqs. (3.22) or (3.23), is 
presented in fig. 1, where the signal was generated by: 

u(t^) = cos(27ifit^+.3) + 0.6-cos(27rf2tk+.5) + 1.4-cos(27if3t^+.8), (3.24) 

with: fi=5 Hz, f2=5.4 Hz, f3=44 Hz, k=l,2,. . .50, fs=30 Hz=l/(At), tk=kA . 

The appearing symmetries (aliasing) will be explained in sec. 7. Using eqs. (3.5a), 

(3.5b), (3. 15b), (3. 18a) we obtain the Parseval theorem in the following form: 

(u|u) = £ [v*u*(t,)][vu(t,)] = £ (u|(co,,j)((co,,J 



k=l k=l 
K 



(3.25) 

= 1 U*(co,^U(co,^ = l, 

k=l 

with a total power normalized to one. From eqs. (3. 18a) and (3.25) we can give 
U(a)]^ „) the meaning of an angular frequency probability amplitude. With this 

definition experiments with a different K (number of data points) will have similar 
values, if the same quantity is measured (unlike the standard DFT). Likewise using 
probability amplitudes allows to define more simply and profoundly various 
average quantities. For example the average angular frequency for the signal can be 
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defined as(u|a)j^|u)/(u|u), where Gi^is the angular frequency operator, which will 

be defined in the section 4. The situation is somewhat complicated due to the fact 
that there are infinitely many orthonormal bases (3. 15b) characterized by the 
parameter a via eq. (3. 15a). Thus: 



(u|u) 



is the average angular frequency in the range: 

(Oi,«<co<cOk,„. (3.27) 

Eq. (3.21) is the symmetry of the Fourier transform of real signals. Therefore 
the basis, which from the point of view of symmetries, is the closest to the Fourier 
transform, seems to be the one with: 

a = -(K-l)/2 = s (3.28) 
(0„, =(n-K/2-l/2)A(0, n=l,2,...,K, (3.29) 
which for real signals has the same symmetry as eq. (3.21), namely: 

U*(co, J = U(-(0, J = U(C0K_k.i,), k = 1,2,...,K, (3.30) 
and therefore only half of the amplitudes has to be computed. 

4. Operators, averages and double distributions 

In a similar way as observables are defined in quantum mechanics we can asign a 

self-adjoint operator, say A, to a measured signal quantity and evaluate its average 
value according to: 



/ 1^1 

(u|A| 






l») 



A =^^^. (4.1) 



Let us give few important examples: 

Example 1: The time operator t will be defined as: 



k=l 



It has the following obvious properties: 
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k=l 



(4.3) 
(4.4) 



The average time will be defined as: 



t =(u|t|u)/(u|u) = £ t,(u|t,)(t,|u)/(u|u) = £ ty\u(t,f. (4.5) 



k=l 



k=l 



Example 2: the angular frequency operator can be defined as: 



k=l 



(4.6) 



where a is a continuous parameter labeling the different orthogonal bases as in eq. 
(3.15a). The operator has the obvious properties: 



CO, 



«>k,a/ = «>k,a 



CO 



k,a / ' 



(4.7) 
(4.8) 



k=l 



The situation is complicated due to the fact that there are infinitely many 
orthonormal bases (3. 15b) characterized by the parameter a. 
The operator has a simple form in the co-basis. In the t-basis it will aquire the 
following form: 



K 



K K K 



<»a=L «k,at»>k,a)(«k,a|=L L L «k,a(«k,a 
k=l 

^ K K K 



«k,a)|tnAtm| 



n=l k=l 

Its average value is equal to: 



m-l n=l k=l 
i«k,a(tm-tn) 



(4.9) 





fOk,«)®k,a{«k,« 




(u u) S 


(u|„) 





ir(co.,„)co,,„U(co,,J 



(4.10) 



k=l \U|U) 

where the angular frequency is in the range: 
Example 3: Let us consider the following operator: 



(4.11) 
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u(tj|t„)(tj, 

n=l 

the "signal operator", which has the following properties: 

u|t^) = u(t^)|t^), 

fiu^=I I u(t„K(t,)|t„)(t„|t,)M=i; |u(tj|>„)(t„|, 



n=l k=l 



n=l 



tr(uu^)=j: |u(t„f, 



(4.12) 

(4.13) 
(4.14) 

(4.15) 



11=1 



Let us consider the transition matrix element: 

K 



(co|u|0> = J: ((0|t„)(tj0)u(tJ = -5: e-^™»u(tj 



n=l 



1 



1 



(4.16) 



(ra|u) = -^U(co) 



Thus the transition matrix of the signal operator between zero and 0) angular 
frequencies is proportional to the spectral amplitude. 
Example 4: We can define also the "spectral operator": 



CO. 



n=l 



which satisfies: 



«n,a>=U(«n,oc)|«n,a). 



(4.17) 

(4.18) 
(4.19) 



n=l 



K K 



k=l n=l 

Let us consider the transition matrix element: 



Kn=l 



(tm|Ua|0) = t (tin|«„,«)(co„,„|o)u(co„,J = ^(t^|u) = ^u(tJ, (4.21) 

n=l V K V K 

with a result symmetric to eq. (4. 16). 

Example 5: One can combine the operators of example 3 and example 4: 
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K K 



UaU'„Uu'=X; L H^nJ |u(tk)| |cO„^„Xf^n,a 



tk)(tkl, 



k=l n=l 



CO, 



U„U'„uu^|t„)=|u(co^^Jp|u(tJ|'{(0^,„ 



Equation (4.23) may form a basis for a double distribution: 



w(t„,co^J={co^„ 



U„U^„uu^|t„) t„ 



CO. 



(4.22) 
(4.23) 

(4.24) 



with the property: 



t w(tn,0)„,a) = ^|uKa)rf; |u(t„f , (4.25) 
11=1 ^ 11=1 



11=1 

K 



1 2 I 

L w(t„,co„J = -|u(tJ| £ |u(co„ J[ 



(4.26) 



111=1 111=1 
Example 6: Approximate time derivative operator. As we show in paper 11, in the 
continuous case, the time derivative is related to the angular frequency operstor via: 

d 



dt 



t|u) = (t|ia)|u). 



(4.26) 



We can use this relation as an approximate derivative at a point: 



dt 



tk|u) = (tk|i<»a|u) = 5^ (t k0„,p)(c0„3 



K K 



n=l 



CO, 



(4.27) 



f^in,aPin,a\t«3in,a 



u . 



n=l m=l 



There exists some arbitrariness in the choice of a and P, if they are equal, one gets: 



dt 



tk|u)s(ti,|ia»Ju) = i2^ (t 



u 



n=l 



= co„,„e'-'«^^u(co„J. 

VJ^ n=l 



(4.28) 



For real signals the result should be real. This is guaranteed for a=s, eq. (3.28). 



5. Non orthonormal bases 



In sec. 3 we assumed orthonormal bases for the Dirac space. They lead to simple 
inverse transformations, like eqs (3. 18a) and (3.19). But that is not the only 
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possibility, we may choose non orthonormal bases. In practice we may encounter 
situations where the bases will not be orthonormal from the beginning, like in the 
case of non uniform sampling and for spectral analysis with different windowing. 
Therefore we should discuss the non orthonormal bases case. We shall consider 
cases where the angular frequency base is non orthogonal but the time base 
orthogonal, frequency base orthogonal and time base non orthogonal, and when 
both bases are non orthogonal. 

Non orthogonal angular frequency base. Let us start with an orthonormal time 
basis like in eqs. (3.4) and (3.6), and non-orthonormal angular frequency basis, for 
which the matrix W: 

Wi^=(co,|co„), k,n = l,2,...K, (5.1) 

is different from the unit matrix 1. The ket-vectors which form the basis have to be 
linearly independent There exist two criteria which can be used in order to check if 
vectors are linearly independent. In the first, we demand that the determinant, which 
columns are the vectors, is different from zero. In the second, the determinant of W 
(the Gram determinant) given by eq. (5.1), should be different from zero. Let us 
describe the first case. Let us define the matrix Q who's columns are the basis 
ket-vectors: 

^^kn=(tk|(0„), (5.2) 

where the index k denotes the k-th row. Let us also define the matrix Q.^ = Q.^'^' , the 
hermitian conjugate of Q., who's rows are the basis bra- vectors: 

q.i:-=Mk), (5.3) 

and n is the index of the n-th column. The condition for the basis to be independent 
is that one of the following determinants is not equal to zero: 

\Q\^0, or |n'^-"|^0, or |W|^0. (5.4) 
The identity operator (the unit matrix ) has the following representation: 

K K K K 



1 = 1 I W;„>,)(co„| = £ Ico.XUV < (co,|, (5.5) 
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where W"^ is the inverse matrix of W and (H^^j is the reciprocal basis ket, 
satisfying: 



CO, 



CO. 



'kn • 



Eq. (5.6) can be also written as: 



CO, 



m=l 

or equivalently: 



m=l 



(5.6) 



(5.7a) 



(5.7b) 



i.e. the reciprocal basis bras are the rows of the inverse of Q and the kets are the 
columns of the inverse of the hermitian conjugate of Q.. 

Let us find the spectral representation of a signal u(t) with the eqs. (3.3-6), 
(3.8-9) and (5.1 -7b): 



u(t,) = (t,|u) = 2^ (t,|co„)(co-^ 



n=l 



(5.8) 



from which the spectral amplitude, which is defined now as ^co^^ u^ , can be 
evaluated, using eqs. (5.7a) and (5.7b): 

u(coj^(co-' u) = £ (co:^ t,Vt,|u) = |; a-Mh)- 



k=l 



(5.9) 



k=l 



Thus the evaluation of the spectral amplitude requires the inversion of the matrix Q., 
which can be problematic if K, the number of data, is very large. Let us note that the 
transformation (3.8), with the requirement (3.10), is a unitary transformation, for 
which Q.~^ = Q.^''^', in this case eq. (5.9) is equal to eq. (3.18) and no inversion is 
needed. Thus the orthogonality of the basis greatly simplifies the calculations. When 
large matrices are involved and changes are small, instead of inverting matrices, one 
can use the following procedure. Define: 



Where Q.o is a unitary matrix satisfying: 



o -1 = o 



(5.10) 



(5.11) 
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The matrix Q.' can then be expanded: 



= (l - Ilo^ ' All)'' ilo' ' = I + Q.^'^'AQ. + (ilo'" A^l)' +. 



h.c. 



(5.12) 



The series (5.12) can be computed using the following successive approximations: 

[^i-if =^2,*^^ +[^2-if^A^2 [a-'f = a,''-. (5.13) 

For small corrections the first (n=l), or the second approximation (n=2) may be 
sufficient. 

In the following we will try to show that orthogonality is also related to stability. 
Let us consider as an example the signal (3.3) in the basis (3.4-6), and the new basis 
described by: 



^nk =(t„|(0k) = -^exp(ic0ktj, 



(5.14) 

co„ =c-(n-l)-Aco, Aco = 27i(KAt)"' , (5.15) 

i.e. we recover the orthogonal basis (3.16) when c=l and we scale the angular 
frequency basis with the factor c. Let us check for which values of c the new basis is 
independent. For that purpose we need to evaluate the determinant 

1 1 ... 1 

exp(ic02ti) exp(ic02t2) ••• exp(ic02tK) 



1 



(Vk)' 



(5.16) 



exp(icOj^ti) exp(iC0gt2) ••• exp(icOgtg) 

which can vanish if either two columns or two rows are dependent. This may happen 
if: 

exp(i • c • Aco • tj.) = exp(i • c • Aco • t^,), 
exp(i • At • cOj^) = exp(i • At • co j ), 

for some values of k, n, m and j. The conditions (5.13) may occur if: 

c • At • Aco(k - n) = 271 • M , 
for some integers k and n not larger than K, and for some integer M. 



(5.17) 



(5.18) 
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From eqs. (5.15) and (5.18) we finally obtain that the determinant (5.16) will vanish 
if: 

MK ^ 0<k<K-l, 0<n<K-l; k ^ n, M = 1,2,3,... • (4.19) 

|k-n| 

For example if K=100, (5. 16) will be zero for 

100 100 100 200 200 200 300 300 300 400 

Q — GtC 

99 ' 98 50 ' 99 ' 98 "■■ 66 ' 99 ' 98 75 ' 99 ' 

For K=50 

50 50 50100100 100150150 150200 

49 48 25 49 48 33 49 48 37 49 

In figs. 2a and 2b the absolute value of the determinant is displayed as a function 
of c for K=50. 

Non orthogonal time basis. Let us consider the case of non uniform sampling, 
i.e. sampling for which the time intervals are not equal. Let us assume that the 
signal u(t) is sampled at times tk , k=0,l,. . .,K and that the average time interval is At. 
We can construct an orthonormal angular frequency basis exactly as in (3.16) with 
the identity operator (matrix) (3.17). We can use this basis in order to find an 
interpolation formula for the basis 1 1 ) , k= 1 ,2, . . . ,K. Assuming the transition (3 . 8), 

with the normalization (3. 14) we arrive at : 

K-1 I K-1 

|tk> = l|tk>=L K|tk>|«n) = ^L [exp(-iC0A)]|«n)- (5.20) 

n=0 V n=0 

Next, we can use the same procedure which led to eqs. (5.2), (5.3), (5.5) and (5.6), 
namely to define 

^^kn=(tk|co„), (5.21) 
to find the reciprocity basis, and the identity operator (matrix) in the form: 

K K 



k=l k=l 

The spectral representation of the signal will be: 



1 = 1 |t.>t^>i: (5.22) 



u(tk)^(tk|u) = £ (t,|co„)(coJu), (5.23) 



n=l 
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from which the spectral amplitude, which is defined now as (a)„ | u) , using eqs. 
(5.21) and (5.22), can be evaluated: 

U(coJ^(coJu) = 2^ («n|tkO(tk|u) = i: i^Xt,). (5.24) 

k=l k=l 

6. A variant of the sampling theorem 

We shall derive a sampling theorem for a finite sampling. We formulate the 
problem in the following way. Let the Dirac space be spanned by the bases (3.4) 
and (3.16). We shall require that our signals (3.5) will depend only on angular 
frequencies 

0<cOk<cOB, 0<B<K, (6.1) 

where B is one of the allowed indices. The immediate consequence of eq. (6.1) is 
that the signals are spanned by a B dimensional angular frequency basis. It means 
that by the requirement (6.1) the signals are found in a lower (than K) dimensional 
space. Within the framework of the Dirac theory this can be achieved by using 
projection operators. Let us define the projection operator: 

P = f |co,)(co,|, (6.2) 

k=0 

which acts in the following way: 

|co^), if m<B, 
0, if m > B. 



k=0 k=0 



(6.3) 



Thus P made a projection into a B dimensional subspace, let us call it Sb. We need 
only a B dimensional basis in the subspace Sb- The kets of eq. (6.3) can form such a 
basis. But what happens now to the basis (3.4)? The requirement (6. 1) means that 
now all ket-vectors were projected to a B dimensional subspace Sb with the aid of 
the projection operator (6.2). The basis (3.4) has also to be projected there: 

B 1 ^ 

P|tm)=L l^k)(«k|tm) = ^L [exP(-it«^ktm)]|o)k) = |x^). (6.4) 

k=0 V k=0 
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The kets I'l^), m= 1 , . . . ,K, also form a basis in Sb, as any vector | v) in the subspace 
Sb can be uniquely expanded with it. : 

|v)^P|v) = PIP|v) = p£ K)(t^|P|v)=£ |x^)(x^|v). (6.5) 

m=l m=l 

While the ket- vectors | cOj, ), < k < B, form a complete basis in Sb, the ket- vectors 

(6.4) form an overcomplete basis, which we also called a coherent states basis. 
Let us specify more carefully the meaning of completeness in the subspace Sb: 

K— 1 B 

P = PIP = p£ I CO, X(0, |P = £ I (0, )((0, I , (6.6) 

k=0 k=0 

thus the projection operator becomes the identity operator in the subspace. 

Let us pose the following question: is it possible to compose out of the K 
ket-vectors |t,) of eq.(3.4), a complete B dimensional basis for Sb? In some 

circumstances, as it will be shown, it is feasible. Let us assume that K is even and 

B=K/2-l, (6.7) 

then: 

K B 

l'c^)=ip|t^)=i; i; |t„)(tjco,)(co,|t^) 

n=l k=0 

^ K B 

= L [exp(ico,(t„-t^))]|t„) 

n=l k=0 

^ly exp(i-Aco-(B + l)-(t„-t^))-l , . 

Kt, exp(i-Aco-(t„-t„))-l ' 
^ly exp[27ri(K/2)(n-m)/K]-l , , 

K;^ exp(i-Aco-(t„-t„))-l ' 
_ 1 exp[7ri(n - m)] - 1 



exp[27ii(n-m)/K]-l' " 
multiplying both sides by P we obtain: 

K exp[27ii(n - m) / K] - 1 
In eq. (6.9) the ket- vector with odd index on the left hand side depends only on even 
indices in the sum on the right hand side and vice versa. Thus the projections of the 



23 



basis |t„) into the subspace Sb form an overcomplete basis there, which can be spHt 
into two complete bases: 

(I) : |Xi),|x3),...,|Xk-i), (6.10) 

(II) : \x,),\x,),...,\x^). (6.11) 
The sampling theorem can be now stated in the following two ways: 

1 



—2 ± 
(X2.|v) = — £ e^p[2;,i(2m-2n + l)/K]-l^''^"-^l''^" 



'2m-l 



_9 K/2 



1 



K fi exp[27ii(2m - 2n - 1) / K] - 1 
where in eqs. (6.12) and (6.13) m=l,...,K/2 . 



(6.12) 
(6.13) 



7. Aliasing 



Let us now study the symmetries of eq. (3. 18. a). Let us note that: 

g-i2jc(a+n-l)k/K _ g-i2jc(±K+a+n-l)k/K _ ^g-i27C(±K-a-n+l)k/K j* 



(7.1) 



(7.2) 



from which we can deduce the following symmetries of eq. (3. 18a) for real 
signals: 

U(CO„,J = U(CO„iK,a) = U*(CO_„iK_J, 

U(co„,„)| = |u(co„iK,«)| = |U(co_„±K,-«)- 

These symmetries in terms of frequencies f are: 

U(f) = U(f ± fs) = U(f ±nfs) = U*(-f ± fs) = U*(-f ±mfs), 
|U(f )| = |U(f ± fs )| = |U(-f ± fs )| = |U(±f ± mfs )|, 

where n and m are integers. The symmetries of eq. (7.3) are the cause of the well 
known phenomenon called aliasing, which occurs when a signal is undersampled 
[21-24]. The ket basis generated by the sampled times is insufficient to reproduce 
the whole signal and has artificial symmetries which are imposed on the spectral 
amplitude. 



(7.3) 
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8. Some identities 



As the number of orthonormal bases in angular frequencies is infinite one can 
get identities in the following way: 



((o|u) = (co| £ |co„^„){(o„^„| |u) = £ 

Vn=l / n=l 

K K 

= L L («|tk)(tk|«„,cx){«n. 

k=l n=l 

J K K |. 

= ^1111 exp(it,((0„„-co 



CO 



U 



«>n,a U 



= exp(iti(co„„-co)) 



exp(itK(co„,„-co))-l 
exp(iti(co„„-co))-l^^"'" 



u 



They are the consequence of the expansion: 



r K 



Vn=l 



K K 



k=l n=l 



K 

= L exp(iti(co„„-co)) 

n=l 



exp(itK((On,a-to))-l 
exp(iti(co„„-co))-l^^"'" 



(8.1) 



(8.2) 



9. The uncertainty principle 



A cmd evaluation of the uncertainty of angular frequency determination can be 
obtained from eq. (3. 14): 

(KAt)Aco=27t, (9.1) 
where KAt is the time window opening and Aco is the grid length of the angular 
frequencies forming an orthogonal basis. If we treat the signal in a way similar to a 
wave function of quantum mechanics, we can obtain in a similar way the time 
frequency uncertainty principle. Let us consider the obvious inequality: 

k=i (9.2) 
= P'(At')-pB + (Aco')>0, 
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where |3 is a real auxiliary parameter and: 

(t) = I t,|vu(t,f , (At^) = f (t,-(t)f|vu(t,f , 

k=l k=l 

K K 

= £ (0,, Ju(co,,„f , (Acon = £ (co,,„-((o)f|u((0,,„f , (9.3) 

k=i k=i 

B = -2f Re[(t, -(t))(co,,„ -(co))(vu(t,)U(co,,„))l. 

k=i 

One can consider the equality sign in eq. (9.2) and the resulting quadratic equation 
in p. The condition for an absence of real solutions in (3 is that: 

(At')(Aco')>BV4, (9.4) 

which is the uncertainty condition. More general discussions of uncertainty relations 
one can find in refs. [8] and [9]. 

10. Summary and conclusions 

We have started section 2 with the basics of Dirac's representation theory and have 
shown its essentials by representing the bras and kets with rows and columns 
respectively. We have introduced there the notion of coherent states and discuss the 
consequences of restricting the vector space to a subspace. In sec. 3 ideas used in 
quantum mechanics, related to the properties of self-adjoint operators, especially the 
orthogonality of states, were employed in signal analysis. The physical states of 
quantum mechanics, corresponding to different eigenvalues, which are eigenstates of 
self-adjoint operators, are orthogonal. Therefore orthogonality means more than a 
convenient tool for expansion of functions. 

In sec. 3 we introduced the "Dirac space" of dimension equal to the number of 
signal data. We gave an extensive analysis of all orthogonal bases labeled with time 
and angular frequencies respectively. The analogy to the quantum wave functions 
was fully employed and averaging quantities were proposed. In sec. 4, in a way 
similar to one used in quantum mechanics operators, observables and averages 
(expectation values) are defined. There we also introduced the signal and spectral 
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operators respectively, and discussed their relation to the spectral amplitude and to 
double distributions. In sec. 5 we have discussed nonorthogonal bases and have 
noticed the peculiar stability of the orthogonal one. In sec. 6, we gave a new variant 
of the sampling theorem. We have decomposed the Dirac space into two subspaces 
of equal dimensions. The sampling theorem was the relation between the complete 
basis in a subspace and the overcomplete basis obtained by projecting the basis of 
the Dirac space into the subspace. In sec. 7 we derived and discussed the symmetries 
which were leading to the aliasing phenomenon. In sec. 8 some identities were 
derived, which were linking different angular frequency bases. In sec. 9 the 
uncertainty principle was derived.. 

In this paper we have demonstrated that the Dirac representation theory can be 
effectively adjusted and applied to signal theory. The main emphasis was put on 
orthogonality as the principal physical requirement. The particular role of the 
identity and projection operators was also stressed. 
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Figure captions 

1. The spectral power P(co) dependence on frequency for the signal of eq. (3.24). 
2a. The absolute value of the determinant as a function of the scaling parameter 
c for K=50. 

2b. Same as Fig. 2a, but with a semi logarithmic axes. 
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A. Gersten, Figure 1 
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